00000001:00080000:2.0F:1787096245.234816:0:6456:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967342 is committed 00010000:00010000:3.0F:1787096245.234867:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a89766000/0x9eebb2eb7f50d201 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x456de995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.234888:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a89766000/0x9eebb2eb7f50d201 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x456de995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.234895:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a89766000/0x9eebb2eb7f50d201 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x456de995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.234900:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7a89766000 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:3.0:1787096245.234905:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a89766000/0x9eebb2eb7f50d201 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x456de995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.234912:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a89766000/0x9eebb2eb7f50d201 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x456de995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.234930:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x456de995 (ffff8c7aadca8100) 00010000:00010000:3.0:1787096245.234933:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096245.234937:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a89766000/0x9eebb2eb7f50d201 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x456de995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.234942:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a89766000/0x9eebb2eb7f50d201 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x456de995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.234969:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a89766c00/0x9eebb2eb7f50d247 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x328fd2b2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.234974:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a89766c00/0x9eebb2eb7f50d247 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x328fd2b2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.234978:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a89766c00/0x9eebb2eb7f50d247 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x328fd2b2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.234982:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7a89766c00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:3.0:1787096245.234990:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a89766c00/0x9eebb2eb7f50d247 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x328fd2b2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.234995:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a89766c00/0x9eebb2eb7f50d247 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x328fd2b2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.235001:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x328fd2b2 (ffff8c7aadca8e00) 00010000:00010000:3.0:1787096245.235003:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096245.235005:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a89766c00/0x9eebb2eb7f50d247 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x328fd2b2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.235010:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a89766c00/0x9eebb2eb7f50d247 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x328fd2b2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.235020:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a89767000/0x9eebb2eb7f50d29b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x328fd2b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.235025:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a89767000/0x9eebb2eb7f50d29b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x328fd2b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.235029:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a89767000/0x9eebb2eb7f50d29b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x328fd2b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.235033:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7a89767000 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:3.0:1787096245.235034:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a89767000/0x9eebb2eb7f50d29b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x328fd2b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.235039:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a89767000/0x9eebb2eb7f50d29b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x328fd2b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.235044:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x328fd2b2 (ffff8c7aadca8e00) 00010000:00010000:3.0:1787096245.235045:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096245.235054:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a89767000/0x9eebb2eb7f50d29b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x328fd2b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.235070:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a89767000/0x9eebb2eb7f50d29b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x328fd2b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.235088:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2751c00/0x9eebb2eb7f50d2e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x57a32597 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.235093:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2751c00/0x9eebb2eb7f50d2e1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x57a32597 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.235097:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2751c00/0x9eebb2eb7f50d2e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x57a32597 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.235101:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7aa2751c00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:3.0:1787096245.235103:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2751c00/0x9eebb2eb7f50d2e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x57a32597 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.235107:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2751c00/0x9eebb2eb7f50d2e1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x57a32597 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.235112:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x57a32597 (ffff8c7aadca8900) 00010000:00010000:3.0:1787096245.235114:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096245.235117:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2751c00/0x9eebb2eb7f50d2e1 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x57a32597 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.235120:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7aa2751c00/0x9eebb2eb7f50d2e1 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x57a32597 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6476 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.235128:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762200/0x9eebb2eb7f50d335 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x57a32597 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.235141:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762200/0x9eebb2eb7f50d335 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x57a32597 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.235145:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762200/0x9eebb2eb7f50d335 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x57a32597 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.235148:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7abd762200 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:3.0:1787096245.235151:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762200/0x9eebb2eb7f50d335 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x57a32597 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.235155:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762200/0x9eebb2eb7f50d335 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x57a32597 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.235160:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x57a32597 (ffff8c7aadca8900) 00010000:00010000:3.0:1787096245.235162:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096245.235164:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762200/0x9eebb2eb7f50d335 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x57a32597 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.235168:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762200/0x9eebb2eb7f50d335 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x57a32597 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.235181:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c8000/0x9eebb2eb7f50d37b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.235184:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c8000/0x9eebb2eb7f50d37b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.235189:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c8000/0x9eebb2eb7f50d37b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.235193:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7a869c8000 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:3.0:1787096245.235200:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c8000/0x9eebb2eb7f50d37b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.235204:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c8000/0x9eebb2eb7f50d37b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.235211:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf93a678a (ffff8c7ab3f9fe00) 00010000:00010000:3.0:1787096245.235212:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096245.235214:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c8000/0x9eebb2eb7f50d37b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.235218:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c8000/0x9eebb2eb7f50d37b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0F:1787096245.744488:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a90178700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1873906084437504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787096245.744497:0:3629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a878b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1873906084437632:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787096245.744578:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096245.744622:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0F:1787096245.744623:0:8360:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084437504 00000100:00100000:0.0:1787096245.744639:0:8360:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084437504 00000100:00100000:2.0:1787096245.744671:0:8361:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084437632 00000100:00100000:2.0:1787096245.744676:0:8361:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084437632 00000100:00100000:0.0:1787096245.744713:0:8360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787096245.744722:0:8361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787096245.744728:0:8360:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7aac3b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906084437504:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787096245.744737:0:8361:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a878b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1873906084437632:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787096245.744751:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1787096245.744757:0:8360:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:2.0:1787096245.744759:0:8361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787096245.744815:0:8360:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7aac3b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906084437504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096245.744820:0:8361:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a878b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1873906084437632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096245.744831:0:8360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787096245.744842:0:8361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:1.0:1787096245.744843:0:3626:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c7a90178700 x1873906084437504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096261 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787096245.744866:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a90178700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1873906084437504:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1787096245.744884:0:3629:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c7a878b4000 x1873906084437632/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096261 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787096245.744900:0:3629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a878b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1873906084437632:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787096245.745507:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7aac3b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3628:1873906084437888:0@lo:400:kworker.0 00000100:00100000:1.0:1787096245.745536:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096245.745554:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a87947100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3628:1873906084438400:0@lo:400:kworker.0 00000100:00100000:1.0:1787096245.745576:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096245.745596:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7ab4f33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1873906084438912:0@lo:400:kworker.0 00000100:00100000:1.0:1787096245.745624:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096245.745649:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787096245.745658:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a87944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1873906084438016:0@lo:400:kworker.0 00000100:00100000:1.0:1787096245.745687:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096245.745715:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a87946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3628:1873906084438528:0@lo:400:kworker.0 00000100:00100000:0.0:1787096245.745734:0:6476:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084437888 00000100:00100000:0.0:1787096245.745738:0:6476:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084437888 00000100:00100000:1.0:1787096245.745743:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096245.745744:0:6477:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084438400 00000100:00100000:3.0:1787096245.745751:0:6477:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084438400 00000100:00100000:0.0:1787096245.745774:0:6476:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084438528 00000100:00100000:1.0:1787096245.745775:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7ab4f31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1873906084439040:0@lo:400:kworker.0 00000100:00100000:0.0:1787096245.745777:0:6476:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084438528 00000100:00100000:3.0:1787096245.745804:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787096245.745809:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096245.745813:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787096245.745819:0:6477:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7ab4f32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1873906084437888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096245.745829:0:6476:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7ab4f32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1873906084438400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096245.745850:0:8359:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084438912 00000100:00100000:1.0:1787096245.745855:0:8359:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084438912 00000100:00100000:3.0:1787096245.745878:0:6477:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7ab4f32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1873906084437888:12345-0@lo:400:kworker.0 Request processed in 65us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096245.745887:0:6476:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7ab4f32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1873906084438400:12345-0@lo:400:kworker.0 Request processed in 63us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096245.745888:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787096245.745890:0:8359:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084439040 00000100:00100000:1.0:1787096245.745895:0:8359:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084439040 00000100:00100000:0.0:1787096245.745901:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787096245.745914:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787096245.745924:0:6477:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7ab4f32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1873906084438528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096245.745938:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7aac3b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:36cee2c3-5860-4e4f-81d9-386cc3395e70:3627:1873906084437760:0@lo:400:kworker.0 00000100:00100000:1.0:1787096245.745939:0:8359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787096245.745955:0:8359:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7ab4f33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1873906084438912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096245.745964:0:6477:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7ab4f32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1873906084438528:12345-0@lo:400:kworker.0 Request processed in 41us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096245.745971:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787096245.745977:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096245.746014:0:8359:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7ab4f33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1873906084438912:12345-0@lo:400:kworker.0 Request processed in 62us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096245.746021:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a87944a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1873906084438272:0@lo:400:kworker.0 00000100:00100000:1.0:1787096245.746037:0:8359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787096245.746069:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096245.746080:0:8359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787096245.746092:0:8359:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7ab4f33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1873906084439040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096245.746092:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7ab4f31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3627:1873906084438784:0@lo:400:kworker.0 00000100:00100000:0.0:1787096245.746120:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096245.746136:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a90178700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1873906084439296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787096245.746162:0:8359:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7ab4f33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1873906084439040:12345-0@lo:400:kworker.0 Request processed in 73us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096245.746173:0:8359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787096245.746176:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096245.746205:0:6482:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084438016 00000100:00100000:0.0:1787096245.746206:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787096245.746211:0:6482:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084438016 00000100:00100000:0.0:1787096245.746218:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a87947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3627:1873906084438144:0@lo:400:kworker.0 00000100:00100000:1.0:1787096245.746251:0:6482:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084438272 00000100:00100000:1.0:1787096245.746256:0:6482:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084438272 00000100:00100000:0.0:1787096245.746268:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096245.746282:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787096245.746294:0:6481:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7ab4f30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1873906084438016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096245.746298:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787096245.746302:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7a87945880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3627:1873906084438656:0@lo:400:kworker.0 00000100:00100000:1.0:1787096245.746312:0:6482:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a9017a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1873906084438272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096245.746350:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096245.746383:0:6481:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7ab4f30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1873906084438016:12345-0@lo:400:kworker.0 Request processed in 64us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096245.746397:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787096245.746404:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7abd60df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1873906084439168:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787096245.746405:0:6482:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a9017a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1873906084438272:12345-0@lo:400:kworker.0 Request processed in 95us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096245.746419:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787096245.746438:0:8384:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084438784 00000100:00100000:0.0:1787096245.746439:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096245.746445:0:8384:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084438784 00000100:00100000:0.0:1787096245.746470:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a87944a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1873906084438272:0@lo:400:kworker.0 00000100:00100000:3.0:1787096245.746481:0:8384:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084438144 00000100:00100000:3.0:1787096245.746486:0:8384:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084438144 00000100:00100000:0.0:1787096245.746503:0:6472:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084437760 00000100:00100000:0.0:1787096245.746507:0:6472:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084437760 00000100:00100000:3.0:1787096245.746508:0:8384:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084438656 00000100:00100000:3.0:1787096245.746513:0:8384:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084438656 00000100:00100000:3.0:1787096245.746545:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787096245.746547:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1787096245.746559:0:8384:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a90179c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1873906084438784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096245.746560:0:6472:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a88507050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36cee2c3-5860-4e4f-81d9-386cc3395e70+23:3627:x1873906084437760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096245.746561:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a87944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1873906084438016:0@lo:400:kworker.0 00010000:00080000:1.0:1787096245.746585:0:3628:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c7a87946d80 x1873906084438528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787096261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787096245.746597:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a87946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3628:1873906084438528:0@lo:400:kworker.0 00000100:00100000:1.0:1787096245.746618:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7ab4f31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1873906084439040:0@lo:400:kworker.0 00000100:00100000:3.0:1787096245.746624:0:8384:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a90179c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1873906084438784:12345-0@lo:400:kworker.0 Request processed in 68us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096245.746630:0:6472:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a88507050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36cee2c3-5860-4e4f-81d9-386cc3395e70+23:3627:x1873906084437760:12345-0@lo:400:kworker.0 Request processed in 70us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096245.746637:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787096245.746637:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7aac3b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3628:1873906084437888:0@lo:400:kworker.0 00000100:00100000:0.0:1787096245.746648:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1787096245.746661:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a87947100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3628:1873906084438400:0@lo:400:kworker.0 00000100:00100000:3.0:1787096245.746662:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787096245.746676:0:8384:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7982392d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1873906084438144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096245.746683:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7ab4f33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1873906084438912:0@lo:400:kworker.0 00000100:00100000:0.0:1787096245.746691:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787096245.746705:0:6478:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7982393800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1873906084438656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096245.746717:0:8384:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7982392d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1873906084438144:12345-0@lo:400:kworker.0 Request processed in 43us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096245.746723:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787096245.746747:0:6478:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7982393800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1873906084438656:12345-0@lo:400:kworker.0 Request processed in 46us (397us total) trans 0 rc 0/0 00000100:00080000:3.0:1787096245.746753:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787096245.746754:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:3.0:1787096245.746759:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787096245.746764:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787096245.746776:0:10997:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084439296 00000100:00100000:3.0:1787096245.746780:0:10997:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084439296 00000100:00100000:0.0:1787096245.746792:0:8360:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084439168 00000100:00100000:0.0:1787096245.746796:0:8360:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084439168 00000100:00100000:3.0:1787096245.746813:0:10997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787096245.746819:0:8360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787096245.746824:0:10997:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7982391180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1873906084439296:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787096245.746830:0:8360:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7ab3eb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1873906084439168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787096245.746843:0:10997:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:0.0:1787096245.746845:0:8360:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787096245.746889:0:10997:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7982391180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1873906084439296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096245.746890:0:8360:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7ab3eb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1873906084439168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096245.746922:0:8360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787096245.746934:0:10997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787096245.746964:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a87947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3627:1873906084438144:0@lo:400:kworker.0 00000100:00100000:0.0:1787096245.746975:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a87945880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3627:1873906084438656:0@lo:400:kworker.0 00000100:00100000:0.0:1787096245.746998:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7abd60df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1873906084439168:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787096245.747012:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7aac3b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:36cee2c3-5860-4e4f-81d9-386cc3395e70:3627:1873906084437760:0@lo:400:kworker.0 00010000:00080000:0.0:1787096245.747026:0:3627:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c7ab4f31500 x1873906084438784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787096261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787096245.747035:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7ab4f31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3627:1873906084438784:0@lo:400:kworker.0 00000100:00100000:0.0:1787096245.747064:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7a90178700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1873906084439296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787096245.751671:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1787096245.751714:0:8384:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077045248 00000100:00100000:3.0:1787096245.751723:0:8384:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077045248 00000100:00100000:3.0:1787096245.751787:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 112 00000100:00100000:3.0:1787096245.751799:0:8384:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7ab4f33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9858421-28a9-4744-99eb-72e5bedc52c4+5:25328:x1873906077045248:12345-192.168.201.52@tcp:101:rm.0 00000100:00080000:1.0:1787096245.751803:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787096245.751821:0:8384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096245.751848:0:8384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c8000/0x9eebb2eb7f50d39e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b40fda expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.751914:0:8384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c9a00/0x9eebb2eb7f50d3a5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.751932:0:8384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c9a00/0x9eebb2eb7f50d3a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.751946:0:8384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c9a00/0x9eebb2eb7f50d3a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787096245.751986:0:8384:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787096245.751990:0:8384:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787096245.752009:0:8384:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c9a00/0x9eebb2eb7f50d3a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.752035:0:8384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c8000/0x9eebb2eb7f50d39e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b40fda expref: 7 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.752073:0:8384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c9a00/0x9eebb2eb7f50d3a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b40fda expref: 6 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.752097:0:8384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7ab3f9fe00) 00010000:00010000:3.0:1787096245.752100:0:8384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787096245.752105:0:8384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7a869c9a00, rc 0) 00000100:00100000:3.0:1787096245.752163:0:8384:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7ab4f33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9858421-28a9-4744-99eb-72e5bedc52c4+6:25328:x1873906077045248:12345-192.168.201.52@tcp:101:rm.0 Request processed in 366us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096245.752171:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 112 00000100:00100000:3.0:1787096245.753526:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1787096245.753580:0:6478:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077045376 00000100:00100000:1.0:1787096245.753586:0:6478:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077045376 00000100:00100000:1.0:1787096245.753630:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 113 00000100:00100000:1.0:1787096245.753640:0:6478:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd60e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+6:25328:x1873906077045376:12345-192.168.201.52@tcp:101:rm.0 00010000:00010000:1.0:1787096245.753651:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096245.753663:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881800/0x9eebb2eb7f50d3ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b40fe1 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096245.753702:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880e00/0x9eebb2eb7f50d3b3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096245.753714:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880e00/0x9eebb2eb7f50d3b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096245.753723:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880e00/0x9eebb2eb7f50d3b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096245.753740:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881000/0x9eebb2eb7f50d3ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf93a678a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096245.753747:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881000/0x9eebb2eb7f50d3ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096245.753754:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881000/0x9eebb2eb7f50d3ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096245.753823:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880000/0x9eebb2eb7f50d3c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096245.753842:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880000/0x9eebb2eb7f50d3c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096245.753851:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880000/0x9eebb2eb7f50d3c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787096245.753880:0:6478:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0xd:0x0]: returning size 0 00000004:00200000:1.0:1787096245.753883:0:6478:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787096245.753894:0:6478:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880000/0x9eebb2eb7f50d3c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096245.753904:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880000/0x9eebb2eb7f50d3c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096245.753913:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880e00/0x9eebb2eb7f50d3b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096245.753921:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880e00/0x9eebb2eb7f50d3b3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096245.753929:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880e00/0x9eebb2eb7f50d3b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096245.753935:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7983880e00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096245.753939:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880e00/0x9eebb2eb7f50d3b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096245.753948:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880e00/0x9eebb2eb7f50d3b3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096245.753959:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7ab3f9fe00) 00010000:00010000:1.0:1787096245.753962:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096245.753975:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880e00/0x9eebb2eb7f50d3b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096245.753982:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880e00/0x9eebb2eb7f50d3b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096245.753994:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881000/0x9eebb2eb7f50d3ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096245.754001:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881000/0x9eebb2eb7f50d3ba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096245.754008:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881000/0x9eebb2eb7f50d3ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096245.754015:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7983881000 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096245.754019:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881000/0x9eebb2eb7f50d3ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096245.754026:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881000/0x9eebb2eb7f50d3ba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096245.754035:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf93a678a (ffff8c7a8b27a000) 00010000:00010000:1.0:1787096245.754038:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096245.754042:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881000/0x9eebb2eb7f50d3ba lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096245.754066:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881000/0x9eebb2eb7f50d3ba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096245.754093:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983881800/0x9eebb2eb7f50d3ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b40fe1 expref: 8 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096245.754120:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880000/0x9eebb2eb7f50d3c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b40fe1 expref: 7 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096245.754129:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8c7a8b27a500) 00010000:00010000:1.0:1787096245.754132:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787096245.754135:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7983880000, rc 0) 00000100:00100000:1.0:1787096245.754173:0:6478:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd60e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+7:25328:x1873906077045376:12345-192.168.201.52@tcp:101:rm.0 Request processed in 535us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096245.754182:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 113 00000100:00100000:2.0:1787096245.756205:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1787096245.756246:0:6477:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077045632 00000100:00100000:3.0:1787096245.756253:0:6477:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077045632 00000100:00100000:3.0:1787096245.756298:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 114 00000100:00100000:3.0:1787096245.756310:0:6477:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a878b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+7:25328:x1873906077045632:12345-192.168.201.52@tcp:36:rm.0 00010000:00010000:3.0:1787096245.756342:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787096245.756446:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7983880000/0x9eebb2eb7f50d3c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b40fe1 expref: 7 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.756463:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8c7a8b27a500) 00010000:00010000:3.0:1787096245.756480:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c9a00/0x9eebb2eb7f50d3a5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b40fda expref: 6 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.756491:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7ab3f9fe00) 00010000:00010000:3.0:1787096245.756500:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787096245.756514:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c8000/0x9eebb2eb7f50d3c8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.756525:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c8000/0x9eebb2eb7f50d3c8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.756547:0:6477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c8000/0x9eebb2eb7f50d3c8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.756561:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c9400/0x9eebb2eb7f50d3cf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf93a678a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.756570:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c9400/0x9eebb2eb7f50d3cf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.756579:0:6477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c9400/0x9eebb2eb7f50d3cf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.756634:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c8c00/0x9eebb2eb7f50d3d6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.756642:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c8c00/0x9eebb2eb7f50d3d6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.756648:0:6477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c8c00/0x9eebb2eb7f50d3d6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.756831:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c9800/0x9eebb2eb7f50d3dd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.756840:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c9800/0x9eebb2eb7f50d3dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.756846:0:6477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c9800/0x9eebb2eb7f50d3dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.756852:0:6477:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c9800/0x9eebb2eb7f50d3dd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.756866:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c9800/0x9eebb2eb7f50d3dd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.756870:0:6477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c9800/0x9eebb2eb7f50d3dd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.756887:0:6477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787096245.756899:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c8c00/0x9eebb2eb7f50d3d6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.756904:0:6477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c8c00/0x9eebb2eb7f50d3d6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.756908:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c8c00/0x9eebb2eb7f50d3d6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.756912:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7a869c8c00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:0.0:1787096245.756914:0:6465:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787096245.756915:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c8c00/0x9eebb2eb7f50d3d6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.756923:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c8c00/0x9eebb2eb7f50d3d6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096245.756924:0:6465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c9800/0x9eebb2eb7f50d3dd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.756933:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8c7ab3f9f400) 00010000:00010000:3.0:1787096245.756937:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787096245.756940:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c8c00/0x9eebb2eb7f50d3d6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096245.756943:0:6465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7a869c9800 already unused, calling callback (ffffffffc0bef6f0) 00010000:00010000:3.0:1787096245.756946:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c8c00/0x9eebb2eb7f50d3d6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096245.756948:0:6465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c9800/0x9eebb2eb7f50d3dd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096245.756963:0:6465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c9800/0x9eebb2eb7f50d3dd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.756968:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c8000/0x9eebb2eb7f50d3c8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096245.756974:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8c7ab3f9f400) 00010000:00010000:0.0:1787096245.756982:0:6465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787096245.756984:0:6477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c8000/0x9eebb2eb7f50d3c8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096245.756987:0:6465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c9800/0x9eebb2eb7f50d3dd lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.756993:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c8000/0x9eebb2eb7f50d3c8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.757003:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7a869c8000 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:3.0:1787096245.757005:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c8000/0x9eebb2eb7f50d3c8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.757016:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c8000/0x9eebb2eb7f50d3c8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096245.757023:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c9800/0x9eebb2eb7f50d3dd lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.757025:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7ab3f9f700) 00010000:00010000:3.0:1787096245.757031:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096245.757036:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c8000/0x9eebb2eb7f50d3c8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.757041:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c8000/0x9eebb2eb7f50d3c8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096245.757044:0:6465:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096245.757059:0:6465:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096245.757062:0:6465:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:3.0:1787096245.757069:0:6477:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000008ee69ecf reply state 00000000adff901b transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c9400/0x9eebb2eb7f50d3cf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.757079:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7a869c9400/0x9eebb2eb7f50d3cf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf93a678a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096245.757084:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf93a678a (ffff8c7ab3f9fc00) 00010000:00010000:3.0:1787096245.757086:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787096245.757088:0:6477:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787096245.757130:0:6477:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a878b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+7:25328:x1873906077045632:12345-192.168.201.52@tcp:36:rm.0 Request processed in 824us (926us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1787096245.757142:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 114 00000100:00100000:3.0:1787096245.850372:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:3.0:1787096245.850428:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1787096245.850447:0:6471:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077045760 00000100:00100000:0.0:1787096245.850457:0:6471:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077045760 00000100:00100000:1.0:1787096245.850496:0:8384:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077045888 00000100:00100000:1.0:1787096245.850502:0:8384:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077045888 00000100:00100000:0.0:1787096245.850519:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 284 00000100:00100000:0.0:1787096245.850533:0:6471:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a88504850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5469a594-d695-447b-b0fa-7bef4580840e+9:2409:x1873906077045760:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:1.0:1787096245.850561:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 152 00000100:00080000:3.0:1787096245.850563:0:6473:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787096245.850572:0:8384:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd60fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9858421-28a9-4744-99eb-72e5bedc52c4+5:2409:x1873906077045888:12345-192.168.201.52@tcp:400:kworker.0 00000100:00100000:0.0:1787096245.850615:0:6471:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a88504850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5469a594-d695-447b-b0fa-7bef4580840e+9:2409:x1873906077045760:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 86us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096245.850619:0:8384:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd60fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9858421-28a9-4744-99eb-72e5bedc52c4+5:2409:x1873906077045888:12345-192.168.201.52@tcp:400:kworker.0 Request processed in 47us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096245.850630:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 284 00000100:00100000:1.0:1787096245.850636:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 152 00010000:00010000:1.0:1787096245.936522:0:8374:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787096246.257474:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7ab4f31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1873906084439424:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787096246.257547:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096246.257584:0:6481:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084439424 00000100:00100000:1.0:1787096246.257592:0:6481:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084439424 00000100:00100000:1.0:1787096246.257646:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787096246.257658:0:6481:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd60c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1873906084439424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787096246.257691:0:6481:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787096246.257739:0:6481:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd60c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1873906084439424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096246.257746:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787096246.257787:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7ab4f31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1873906084439424:0@lo:41:osp-pre-1-0.0 00000001:02000400:3.0:1787096246.270057:0:18808:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 6b: EC write selects data mirror, not parity mirror ========================================================== 19:37:25 (1787096245) 00000100:00100000:0.0:1787096246.320880:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1787096246.320946:0:6478:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077046016 00000100:00100000:0.0:1787096246.320956:0:6478:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077046016 00000100:00100000:0.0:1787096246.321016:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 115 00000100:00100000:0.0:1787096246.321026:0:6478:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7ab3eb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+7:25490:x1873906077046016:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1787096246.321065:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096246.321084:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763a00/0x9eebb2eb7f50d3e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b40fe8 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.321138:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762c00/0x9eebb2eb7f50d3eb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.321152:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762c00/0x9eebb2eb7f50d3eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.321177:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762c00/0x9eebb2eb7f50d3eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787096246.321221:0:6478:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787096246.321226:0:6478:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787096246.321245:0:6478:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762c00/0x9eebb2eb7f50d3eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.321265:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763a00/0x9eebb2eb7f50d3e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b40fe8 expref: 9 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.321279:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762c00/0x9eebb2eb7f50d3eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b40fe8 expref: 8 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.321285:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a92c71c00) 00010000:00010000:0.0:1787096246.321288:0:6478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787096246.321290:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7abd762c00, rc 0) 00000100:00100000:0.0:1787096246.321346:0:6478:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7ab3eb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9858421-28a9-4744-99eb-72e5bedc52c4+8:25490:x1873906077046016:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 322us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096246.321351:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 115 00000100:00100000:2.0:1787096246.322389:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1787096246.322419:0:6477:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077046144 00000100:00100000:0.0:1787096246.322425:0:6477:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077046144 00000100:00100000:0.0:1787096246.322471:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 116 00000100:00100000:0.0:1787096246.322481:0:6477:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a878b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+8:25490:x1873906077046144:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1787096246.322492:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096246.322504:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763400/0x9eebb2eb7f50d3f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b40fef expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.322556:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763200/0x9eebb2eb7f50d3f9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.322564:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763200/0x9eebb2eb7f50d3f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.322571:0:6477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763200/0x9eebb2eb7f50d3f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.322585:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762800/0x9eebb2eb7f50d400 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.322590:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762800/0x9eebb2eb7f50d400 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.322599:0:6477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762800/0x9eebb2eb7f50d400 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.322634:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763200/0x9eebb2eb7f50d3f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.322643:0:6477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763200/0x9eebb2eb7f50d3f9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.322651:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763200/0x9eebb2eb7f50d3f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.322659:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7abd763200 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:0.0:1787096246.322664:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763200/0x9eebb2eb7f50d3f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.322695:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763200/0x9eebb2eb7f50d3f9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.322708:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a92c71c00) 00010000:00010000:0.0:1787096246.322711:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096246.322716:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763200/0x9eebb2eb7f50d3f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.322724:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763200/0x9eebb2eb7f50d3f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.322736:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762800/0x9eebb2eb7f50d400 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.322744:0:6477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762800/0x9eebb2eb7f50d400 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.322751:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762800/0x9eebb2eb7f50d400 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.322757:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7abd762800 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:0.0:1787096246.322761:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762800/0x9eebb2eb7f50d400 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.322768:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762800/0x9eebb2eb7f50d400 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.322779:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x64d10ce5 (ffff8c7a92c71a00) 00010000:00010000:0.0:1787096246.322782:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096246.322786:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762800/0x9eebb2eb7f50d400 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.322805:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762800/0x9eebb2eb7f50d400 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6477 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.322841:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763400/0x9eebb2eb7f50d3f2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b40fef expref: 9 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.322853:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a92c71c00) 00010000:00010000:0.0:1787096246.322855:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096246.322859:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763400/0x9eebb2eb7f50d3f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b40fef expref: 9 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.322869:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7abd763400, rc 0) 00000100:00100000:0.0:1787096246.322906:0:6477:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a878b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+8:25490:x1873906077046144:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 426us (519us total) trans 0 rc 301/301 00000100:00100000:0.0:1787096246.322915:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 116 00000100:00100000:3.0:1787096246.324453:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1787096246.324488:0:8384:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077046400 00000100:00100000:0.0:1787096246.324493:0:8384:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077046400 00000100:00100000:0.0:1787096246.324530:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 117 00000100:00100000:0.0:1787096246.324538:0:8384:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7abd60df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9858421-28a9-4744-99eb-72e5bedc52c4+8:25490:x1873906077046400:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1787096246.324546:0:8384:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096246.324548:0:8384:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787096246.324559:0:8384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762c00/0x9eebb2eb7f50d3eb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b40fe8 expref: 8 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.324569:0:8384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a92c71c00) 00010000:00010000:0.0:1787096246.324576:0:8384:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787096246.324592:0:8384:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762e00/0x9eebb2eb7f50d407 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b40ff6 expref: -99 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.324639:0:8384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763000/0x9eebb2eb7f50d40e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.324649:0:8384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763000/0x9eebb2eb7f50d40e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.324660:0:8384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763000/0x9eebb2eb7f50d40e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.324677:0:8384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762600/0x9eebb2eb7f50d415 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.324685:0:8384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762600/0x9eebb2eb7f50d415 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.324694:0:8384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762600/0x9eebb2eb7f50d415 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.325053:0:8384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762400/0x9eebb2eb7f50d41c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.325061:0:8384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762400/0x9eebb2eb7f50d41c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.325068:0:8384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762400/0x9eebb2eb7f50d41c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787096246.325075:0:8384:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787096246.325091:0:8384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763000/0x9eebb2eb7f50d40e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.325104:0:8384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763000/0x9eebb2eb7f50d40e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.325109:0:8384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763000/0x9eebb2eb7f50d40e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.325112:0:8384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7abd763000 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:0.0:1787096246.325114:0:8384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763000/0x9eebb2eb7f50d40e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.325118:0:8384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763000/0x9eebb2eb7f50d40e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.325124:0:8384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a92c71b00) 00010000:00010000:0.0:1787096246.325125:0:8384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096246.325127:0:8384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763000/0x9eebb2eb7f50d40e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.325132:0:8384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763000/0x9eebb2eb7f50d40e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787096246.325139:0:8384:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000000008a2fa reply state 000000005e4e074d transno 4294967344 ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762600/0x9eebb2eb7f50d415 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.325146:0:8384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762600/0x9eebb2eb7f50d415 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x64d10ce5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.325150:0:8384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x64d10ce5 (ffff8c7a92c71400) 00010000:00010000:0.0:1787096246.325152:0:8384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787096246.325154:0:8384:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787096246.325173:0:8384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762e00/0x9eebb2eb7f50d407 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b40ff6 expref: 10 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.325192:0:8384:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762400/0x9eebb2eb7f50d41c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b40ff6 expref: 9 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.325197:0:8384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c7a92c71700) 00010000:00010000:0.0:1787096246.325199:0:8384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787096246.325201:0:8384:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7abd762400, rc 0) 00000100:00100000:0.0:1787096246.325229:0:8384:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7abd60df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9858421-28a9-4744-99eb-72e5bedc52c4+10:25490:x1873906077046400:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 694us (779us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1787096246.325234:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 117 00000100:00100000:2.0:1787096246.326740:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:0.0:1787096246.326771:0:10275:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077046656 00000100:00100000:0.0:1787096246.326775:0:10275:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077046656 00000100:00100000:0.0:1787096246.326803:0:10275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 118 00000100:00100000:0.0:1787096246.326810:0:10275:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a878b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+10:25490:x1873906077046656:12345-192.168.201.52@tcp:101:lfs.0 00010000:00010000:0.0:1787096246.326819:0:10275:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096246.326826:0:10275:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762000/0x9eebb2eb7f50d42a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4ef7bc65b7b40ffd expref: -99 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.326860:0:10275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763800/0x9eebb2eb7f50d431 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.326868:0:10275:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762400/0x9eebb2eb7f50d41c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b40ff6 expref: 11 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.326874:0:10275:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763800/0x9eebb2eb7f50d431 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.326896:0:10275:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762400/0x9eebb2eb7f50d41c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b40ff6 expref: 11 pid: 8384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.326917:0:10275:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762400/0x9eebb2eb7f50d41c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b40ff6 expref: 11 pid: 8384 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096246.326933:0:10275:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c7ab3eb9880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10275:1873906084439552:192.168.201.52@tcp:104: 00000100:00100000:0.0:1787096246.326995:0:10275:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c7983301f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787096246.327751:0:10275:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c7ab3eb9880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10275:1873906084439552:192.168.201.52@tcp:104: 00010000:00010000:0.0:1787096246.327764:0:10275:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763800/0x9eebb2eb7f50d431 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096246.327949:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1787096246.327994:0:8375:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077046784 00000100:00100000:1.0:1787096246.328000:0:8375:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077046784 00010000:00010000:1.0:1787096246.328024:0:8375:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762400/0x9eebb2eb7f50d41c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b40ff6 expref: 12 pid: 8384 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096246.328069:0:8375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 49 00000100:00100000:1.0:1787096246.328079:0:8375:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a878b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+12:2409:x1873906077046784:12345-192.168.201.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787096246.328089:0:8375:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787096246.328095:0:8375:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762400/0x9eebb2eb7f50d41c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b40ff6 expref: 12 pid: 8384 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096246.328109:0:8375:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762400/0x9eebb2eb7f50d41c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b40ff6 expref: 12 pid: 8384 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096246.328124:0:8375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762400/0x9eebb2eb7f50d41c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b40ff6 expref: 12 pid: 8384 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096246.328136:0:8375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c7a92c71700) 00010000:00010000:1.0:1787096246.328141:0:8375:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763800/0x9eebb2eb7f50d431 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096246.328150:0:8375:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763800/0x9eebb2eb7f50d431 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096246.328157:0:8375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763800/0x9eebb2eb7f50d431 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096246.328178:0:8375:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787096246.328189:0:10275:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763800/0x9eebb2eb7f50d431 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.328196:0:10275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763800/0x9eebb2eb7f50d431 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787096246.328204:0:10275:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000100:00100000:1.0:1787096246.328210:0:8375:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a878b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+11:2409:x1873906077046784:12345-192.168.201.52@tcp:103:ldlm_bl.0 Request processed in 133us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096246.328226:0:8375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 49 00010000:00010000:0.0:1787096246.328283:0:10275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763800/0x9eebb2eb7f50d431 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.328288:0:10275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763800/0x9eebb2eb7f50d431 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.328292:0:10275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763800/0x9eebb2eb7f50d431 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.328296:0:10275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c7abd763800 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:0.0:1787096246.328297:0:10275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763800/0x9eebb2eb7f50d431 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.328310:0:10275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763800/0x9eebb2eb7f50d431 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.328317:0:10275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c7a92c71700) 00010000:00010000:0.0:1787096246.328319:0:10275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787096246.328321:0:10275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763800/0x9eebb2eb7f50d431 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.328325:0:10275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd763800/0x9eebb2eb7f50d431 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10275 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.328342:0:10275:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762000/0x9eebb2eb7f50d42a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b40ffd expref: 10 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.328348:0:10275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c7a92c71d00) 00010000:00010000:0.0:1787096246.328349:0:10275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787096246.328352:0:10275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c7abd762000/0x9eebb2eb7f50d42a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.52@tcp remote: 0x4ef7bc65b7b40ffd expref: 10 pid: 10275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096246.328382:0:10275:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c7abd762000, rc 0) 00000100:00100000:0.0:1787096246.328409:0:10275:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a878b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9858421-28a9-4744-99eb-72e5bedc52c4+9:25490:x1873906077046656:12345-192.168.201.52@tcp:101:lfs.0 Request processed in 1599us (1669us total) trans 0 rc 301/301 00000100:00100000:0.0:1787096246.328415:0:10275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 118 00000100:00100000:2.0:1787096246.329257:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.52@tcp (source: 12345-192.168.201.52@tcp) 00000100:00100000:1.0:1787096246.329299:0:6480:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906077047040 00000100:00100000:1.0:1787096246.329304:0:6480:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906077047040 00000100:00100000:1.0:1787096246.329339:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.52@tcp, seq: 17 00000100:00100000:1.0:1787096246.329349:0:6480:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7a878b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+9:25490:x1873906077047040:12345-192.168.201.52@tcp:35:lfs.0 00000100:00100000:1.0:1787096246.329608:0:6480:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7a878b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9858421-28a9-4744-99eb-72e5bedc52c4+10:25490:x1873906077047040:12345-192.168.201.52@tcp:35:lfs.0 Request processed in 260us (350us total) trans 4294967345 rc 0/0 00000100:00100000:1.0:1787096246.329617:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.52@tcp, seq: 17 00000100:00100000:0.0:1787096246.769467:0:3629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c79838cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1873906084439680:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787096246.769551:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096246.769598:0:7980:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084439680 00000100:00100000:2.0:1787096246.769606:0:7980:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084439680 00000100:00100000:2.0:1787096246.769661:0:7980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787096246.769671:0:7980:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c7ab3eb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3629:x1873906084439680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787096246.769703:0:7980:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787096246.769760:0:7980:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c7ab3eb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3629:x1873906084439680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096246.769770:0:7980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787096246.769796:0:3629:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c79838cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1873906084439680:0@lo:41:osp-pre-0-1.0 00000001:02000400:1.0:1787096246.784745:0:18856:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-ec test_6b: @@@@@@ FAIL: create EC file failed 00010000:00010000:1.0:1787096246.960500:0:7400:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 546 lines, 546 kept, 0 dropped, 0 bad.